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IN THE CLAIMS 

The following is a complete listing of the claims, and replaces all earlier versions 

and listings. 

1 . (currently amended) A method of monitoring performance of an 
interactive voice response (IVR) system used by an automated call processing center, a call from 
a caller to the call processing centering including an initial IVR portion of the call, and, at the 
caller's option, an agent-caller dialog portion of the call, said method comprising: 

generating logs of call activity within the IVR system for a plurality of calls; 

determining, from the logs of call activity, routing information related to the 
plurality of calls within the IVR system, including routing of calls out of the IVR system to an 
agent; 

noting, in the logs of call activity, predetermined significant activity in agent- 
caller dialog portions of calls routed to an agent; 

determining at least one effectiveness quantity corr e lat e d by comparing a reason 
for a call implied from the routing information related to the call to a true intention of the caller 
determined from the agent-caller dialog portion of the calle rs utilizing the IVR aystom ; 

generating a performance model of the IVR system from the logs of call activity, 

and 

analyzing the logs of call activity, the determined routing information, the at least 
one dotorminod effectiveness quantity corr e lated to th e truo intention of tho oalloro , and the 
performance model to determine a performance value of the IVR system, wherein the 
performance value is used to monitor the IVR system. 

2, (currently amended) A method according to Claim 1 , wherein ooid step 
ef determining at l e ast on e quantity a true intention of a caller includes asking a caller about 
his/her true intention for calling the call processing center. 
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3. (original) A method according to Claim 1, wherein said step of 
determining includes obtaining information from an agent to determine a true intention of a 
caller. 



4. (original) A method according to Claim 1 , wherein said method is 
performed on an ongoing basis. 

5. (currently amended) A method according to Claim 1 , wherein the at least 
one d e t e rmine d effectiveness quantity correlates to a routing accuracy of the IVR system. 



6. (original) A method according to Claim 1 , further comprising the step 
of generating an alarm when the performance value of the IVR system is determined to be below 
a predetermined value. 

7. (currently amended) An apparatus for monitoring performance of an 
interactive voice response (IVR) system used by an automated call processing center, a call from 
a caller to the call processing centering including an initial IVR portion of the call, and, at the 
caller's option, an agent-caller dialog portion of the call, said apparatus comprising: 

means for generating logs of call activity within the IVR system for a plurality of 

calls; 

means for determining, from the logs of call activity, routing information related 
to the plurality of calls within the IVR system, including routing of calls out of the IVR system to 
an agent; 

means for noting, in the logs of call activity, predetermined significant activity in 
agent-caller dialog portions of calls routed to an agent; 

means for determining at least one effectiveness quantity oorrolatod bv comparing 
a reason for a call implied from the routing information related to the call to a true intention of 
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the caller determined f rom the agent-caller dialog portion of the calle rs utilizing tho IVR oystom ; 

means for generating a performance model of the IVR system from the logs of call 

activity; and 

means for analyzing the logs of call activity, the determined routing information, 
the at least one d e termined effectiveness quantity oorrolatod to tho true intention of th e oollore , 
and the performance model to determine a performance value of the IVR system, wherein the 
performance value is used to monitor the IVR system. 

8. (currently amended) An apparatus according to Claim 7, wherein said 
means for determining at least one effectiveness quantity asks a caller about his/her true intention 
for calling the call processing center. 

9. (currently amended) An apparatus according to Claim 7, wherein said 
means for determining at least one effectiveness quantity obtains information from an agent to 
determine a true intention of a caller. 

10. (original) An apparatus according to Claim 7, wherein said apparatus 
operates on an ongoing basis. 

11. (currently amended) An apparatus according to Claim 7, wherein the at 
least one measured effectiveness quantity correlates to a routing accuracy of the IVR system. 

1 2. (original) An apparatus according to Claim 7, further comprising 
means for generating an alarm when the performance value of the IVR system is determined to 
be below a pi^etermined value. 

1 3 . (currently amended) An apparatus for monitoring performance of an 
interactive voice response (IVR) system used by an automated call processing center, a call from 
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a caller to the call processing centering including an initial IVR portion of the call, and, at the 
caller's option, an agent-caller dialog portion of the call, said apparatus comprising: 

a log generation unit adapted to generate logs of call activity within the IVR 
system for a plurality of calls; 

a routing information determination unit adapted to determine, from the logs of 
call activity, routing information related to the plurality of calls within the IVR system, including 
routing of calls out of the IVR system to an agent; 

a significant activity notation unit adapted to note, in the logs of call activity, 
predetermined significant activity in agent-caller dialog portions of calls routed to an agent; 

an truo intention effectiveness determination unit adapted to determine at least 
one effectiveness quantity oorrolotod by comparing a reason for a call implied from the routing 
information related to the call to a true intention of the caller determined from the agent-caller 
dialog portion of the calle rs utilizing th e IVR system ; 

a performance model generation unit adapted to generate a performance model of 
the IVR system from the logs of call activity; and 

an analysis unit adapted to analyze the logs of call activity, the determined routing 
information, the at least one d e termine d effectiveness quantity correlated to tho tru e- int e ntion of 
the call e rs , and the performance model to determine a performance value of the IVR system, 
wherein the performance value is used to monitor the IVR system. 

1 4. (currently amended) A system for monitoring performance of an 
interactive voice response (IVR) system used by an automated call processing center, a call from 
a caller to the call processing centering including an initial IVR portion of the call, and, at the 
caller's option, an agent-caller dialog portion of the call, said system being operable to: 

generate logs of call activity within the IVR system for a plurality of calls; 

determine, from the logs of call activity, routing information related to the 
plurality of calls within the IVR system, including routing of calls out of the IVR system to an 
agent; 
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note, in the logs of call activity, predetermined significant activity in agent-caller 
dialog portions of calls routed to an agent; 

determine at least one effectiveness quantity correlat e d bv compari ng a reason for 
a call implied from the routing information related to the call to a true intention of the caller 
determined from the agent-caller dialog portion of the calle r s utilizing tho IVR oyat e m ; 

generate a performance model of the IVR system from the logs of call activity; 

and 

analyze the logs of call activity, the determined routing information, the at least 
one effectiveness quantity correlat e d to th e tru e intention of tho oalloro , and the performance 
model to determine a performance value of the IVR system, wherein the performance value is 
used to monitor the IVR system. 

15. (original) A system according to Claim 14, wherein a true intention of 
a caller is determined by asking the caller of his/her reason for calling the call processing center. 

16. (original) A system according to Claim 14, wherein a true intention of 
a caller is determined from information obtained from an agent. 

17. (original) A system according to Claim 1 4, wherein said system 
operates on an ongoing basis. 

18. (currently amended) A system according to Claim 14, wherein the at 
least one effectiveness quantity correlates to a routing accuracy of the IVR system. 

1 9. (original) A system according to Claim 1 4, wherein said system 
further operates to generate an alarm when the performance value of the IVR system is 
determined to be below a predetermined value. 
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20. (currently amended) A computer program product embodying a program 
for implementing a method of monitoring performance of an interactive voice response (IVR) 
system used by an automated call processing center, a call from a caller to the call processing 
centering including an initial IVR portion of the call, and, at the caller's option, an agent-caller 
dialog portion of the call, said program product comprising: 

code for generating logs of call activity within the IVR system for a plurality of 

calls; 

code for determining, from the logs of call activity, routing information related to 
the plurality of calls within the IVR system, including routing of calls out of the IVR system to 
an agent; 

code for noting, in the logs of call activity, predetermined significant activity in 
agent-caller dialog portions of calls routed to an agent; 

code for determining at least one effectiveness quantity corr e lat e d by comparing a 
reason for a call implied from the routing information related to the call to a true intention ofthe 
caller determined from the agent-caller dialog portion of the calle ro utilizing the IVR system ; 

code for generating a performance model of the IVR system from the logs of call 

activity; and 

code for analyzing the logs of call activity, the determined routing information, 
the at least one d e termine d effectiveness quantity corr e lat e d to th e tru e int e ntion of the callers , 
and the performance model to determine a performance value of the IVR system, wherein the 
performance value is used to monitor the IVR system. 

2 1 . (original) A computer program product according to Claim 20, 
wherein a true intention of a caller is determined by asking the caller of his/her reason for calling 
the call processing center. 

22. (original) A computer program product according to Claim 20, 
wherein a true intention of a caller is determined from information obtained from an agent. 
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23 . (original) A computer program product according to Claim 20, 
wherein the method is performed on an ongoing basis. 

24. (currently amended) A computer program product according to Claim 
20, wherein the at least one determin e d effectiveness quantity correlates to a routing accuracy of 
the IVR system. 

25 . (original) A computer program product according to Claim 20, 
further comprising code for generating an alarm when the performance value of the IVR system 
is determined to be below a predetermined value. 

26. (currently amended) A method of monitoring performance of an 
automated response system used by an automated contact processing center, a contact from a 
contactor to the contact processing centering including an initial automated portion of the 
contact, and, at the contactor's option, an agent-contactor dialog portion of the contact, said 
method comprising: 

generating logs of contact activity within the automated response system for a 

plurality of contacts; 

determining, from the logs of contact activity, routing information related to the 
plurality of contacts within the automated response system, including routing of contacts out of 
the automated response system to an agent; 

noting, in the logs of contact activity, predetermined significant activity in agent- 
contactor dialog portions of contacts routed to an agent; 

determining at least one effectiveness quantity correlat e d by comparing a reason 
for a contact implied from the routine information re lated to the contact to a true intention of the 
contactor determined from the agent-caller dialog portion of the contact ors utilising th e 
automated rooponsc syotom ; 
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generating a performance model of the automated response system from the logs 
of contact activity; and 

analyzing the logs of contact activity, the determined routing information, the at 
least one determine d effectiveness quantity oorrolatod to th e tru e int e ntion of tho oontaotora , and 
the performance model to determine a performance value of the automated response system, 
wherein the performance value is used to monitor the automated response system. 

27. (currently amended) An apparatus for monitoring performance of an 
automated response system used by an automated contact processing center, a contact from a 
contactor to the contact processing centering including an initial automated portion of the 
contact, and, at the contactor's option, an agent-contactor dialog portion of the contact, said 
apparatus comprising: 

means for generating logs of contact activity within the automated response 
system for a plurality of contacts; 

means for determining, from the logs of contact activity, routing information 
related to the plurality of contacts within the automated response system, including routing of 
contacts out of the automated response system to an agent; 

means for noting, in the logs of contact activity, predetermined significant activity 
in agent-contactor dialog portions of contacts routed to an agent; 

means for determining at least one effectiveness quantity corr e lat e d bv comparing 
a reason for a contact implied from the routing information related to the contact to a true 
intention the contactor determined from the agent-caller dialog portion of the of contactors 
utilising tho automated response syst e m ; 

means for generating a performance model of the automated response system 
from the logs of contact activity; and 

means for analyzing the logs of contact activity, the determined routing 
information, the at least one determin e d effectiveness quantity corr e lat e d to th e tru e int e ntion of 
tho oontaotoro , and the performance model to determine a performance value of the automated 
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response system, wherein the performance value is used to monitor the automated response 
system. 

28. (currently amended) An apparatus for monitoring performance of an 
automated response system used by an automated contact processing center, a contact from a 
contactor to the contact processing centering including an initial automated portion of the 
contact, and, at the contactor's option, an agent-contactor dialog portion of the contact, said 
apparatus comprising: 

a log generation unit adapted to generate logs of contact activity within the 
automated response system for a plurality of contacts; 

a routing information determination unit adapted to determine, from the logs of 
contact activity, routing information related to the plurality of contacts within the automated 
response system, including routing of contacts out of the automated response system to an agent; 

a significant activity notation unit adapted to note, in the logs of contact activity, 
predetermined significant activity in agent-contactor dialog portions of contacts routed to an 
agent; 

an true - int e nti o n effectiveness determination unit adapted to determine at least 
one effectiveness quantity corr e lated by comparing a reason for a contact implied from the 
routing information related to the contact to a true intention of the contactor determined from the 
agent-caller dialog portion of the contact ors utilizing th e automat e d respons e system ; 

a performance model generation unit adapted to generate a performance model of 
the automated response system from the logs of contact activity; and 

an analysis unit adapted to analyze the logs of contact activity, the determined 
routing information, the at least one d e t e rmin e d effectiveness quantity corr e lated to tho true 
int e ntion of th e contactors , and the performance model to determine a performance value of the 
automated response system, wherein the performance value is used to monitor the automated 
response system. 
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29. (currently amended) A system for monitoring performance of an 
automated response system used by an automated response processing center, a contact from a 
contactor to the contact processing centering including an initial automated portion of the 
contact, and, at the contactor's option, an agent-contactor dialog portion of the contact, said 
system being operable to: 

generate logs of contact activity within the automated response system for a 
plurality of contacts; 

determine, from the logs of contact activity, routing information related to the 
plurality of contacts within the automated response system, including routing of contacts out of 
the automated response system to an agent; 

note, in the logs of contact activity, predetermined significant activity in agent- 
contactor dialog portions of contacts routed to an agent; 

determine at least one effectiveness quantity corr e lat e d by comparing a reason for 
a contactor implied from the routing information related to the contact to a true intention of the 
contactor determined from the agent-caller dialog portion of the contac tors utilizing th e 
automated rooponoo oyotom ; 

generate a performance model of the automated response system from the logs of 
contact activity; and 

analyze the logs of contact activity, the determined routing information, the at 
least one effectiveness quantity corr e lat e d to th e tru e int e ntion of th e contactors , and the 
performance model to determine a performance value of the automated response system, wherein 
the performance value is used to monitor the automated response system. 

30. (currently amended) A computer program product embodying a program 
for implementing a method of monitoring performance of an automated response system used by 
an automated contact processing center, a contact from a contactor to the contact processing 
centering including an initial automated portion of the contact, and, at the contactor's option, an 
agent-contactor dialog portion of the contact, said program product comprising: 
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code for generating logs of contact activity within the automated response system 
for a plurality of contacts; 

code for determining, from the logs of contact activity, routing information related 
to the plurality of contacts within the automated response system, including routing of contacts 
out of the automated response system to an agent; 

code for noting, in the logs of contact activity, predetermined significant activity 
in agent-contactor dialog portions of contacts routed to an agent; 

code for determining at least one effectiveness quantity eorr e lat e d by comparing a 
reason for a contact i mplied from the routing information related to the contact to a true intention 
of the contactor determined from the agent-caller dialog portion of the contac tors utilizing tho 
automated r e oponG e syst e m ; 

code for generating a performance model of the automated response system from 
the logs of contact activity, and 

code for analyzing the logs of contact activity, the determined routing 

information, the at least one d e t e rmine d effectiveness quantity correlated to th e tru e intention of 
th e oontaotoro , and the performance model to determine a performance value of the automated 
response system, wherein the performance value is used to monitor the automated response 
system. 
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